A Latent Class Approach to Estimating Test-Score Reliability
نویسندگان
چکیده
This study presents a general framework for single-administration reliability methods, such as Cronbach’s alpha, Guttman’s lambda-2, and method MS. This general framework was used to derive a new approach to estimating test-score reliability by means of the unrestricted latent class model. This new approach is the latent class reliability coefficient (LCRC). Unlike other single-administration reliability methods, LCRC places few restrictions on the item scores. A simulation study showed that if data are multidimensional or if double monotonicity does not hold, then LCRC is less biased relative to the true reliability than Cronbach’s alpha, Guttman’s lambda-2, method MS, and the split-half reliability coefficient.
منابع مشابه
An application of Measurement error evaluation using latent class analysis
Latent class analysis (LCA) is a method of evaluating non sampling errors, especially measurement error in categorical data. Biemer (2011) introduced four latent class modeling approaches: probability model parameterization, log linear model, modified path model, and graphical model using path diagrams. These models are interchangeable. Latent class probability models express l...
متن کاملMultilevel Propensity Score Methods for Estimating Causal Effects: A Latent Class Modeling Strategy
Despite their appeal, randomized experiments cannot always be conducted, for example, due to ethical or practical reasons. In order to remove selection bias and draw causal inferences from observational data, propensity score matching techniques have gained increased popularity during the past three decades. Although propensity score methods have been studied extensively for single-level data, ...
متن کاملThe Hamilton Rating Scale for Depression: A meta-analytic reliability generalization study
Reliability generalization is a meta-analytic approach to study how reliability estimates of a test scores depend on the specific characteristics under which the test is applied and, as a consequence, the risks of inducing score reliability from previous applications of the test. The Hamilton Rating Scale for Depression (HAMD) is one the most popular measurement instruments in clinical psycholo...
متن کاملThe Comparison of Two Models for Evaluation of Pre-internship Comprehensive Test: Classical and Latent Trait
Introduction: Despite the widespread use of pre-internship comprehensive test and its importance in medical students’ assessment, there is a paucity of the studies that can provide a systematic psychometric analysis of the items of this test. Thus, the present study sought to assess March 2011 pre-internship test using classical and latent trait models and compare their results. Methods: In th...
متن کاملEstimating diagnostic accuracy of raters without a gold standard by exploiting a group of experts.
In diagnostic medicine, estimating the diagnostic accuracy of a group of raters or medical tests relative to the gold standard is often the primary goal. When a gold standard is absent, latent class models where the unknown gold standard test is treated as a latent variable are often used. However, these models have been criticized in the literature from both a conceptual and a robustness persp...
متن کامل